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Abstract. An alternate form for the binomial tail is presented, which leads 
to a variety of bounds for the central tail. A few can be weakened into the 
corresponding Chernoff and Slud bounds, which not only demonstrates the 
quality of the presented bounds, but also provides alternate proofs for the 
classical bounds. 



1. Introduction 

Let B(j>, n) denote a binomial random variable comprising n flips of a bias-p 
coin, and set a = \^p(l — p)- The classical form of the central tail, obtained by 
summing over the possible outcomes, is 



1.1 



e [B(p,n) > n/2] 



p\l-p) n - 



E 

h=\n/2] 

If instead B is considered from the perspective of random walks on the integer line, 
another representation is possible by tracking, as n increases, the motion of mass 
from one side of the origin to the other. This intuition is formalized in Iscction 2l 
and results in the following statement. 



Theorem 1.1. When n is odd and p < 1/2, 

(n-l)/2 

¥[B(p,n)>n/2]=p-(l/2-p) £ )a 

3 = 1 



(1.2) 



2A -2j 



(1.3) 



(1/2 -p) E 



j>(n+l)/2 



2j 



r 2 i 



To demonstrate the value of this new characterization of the central tail, it is used 
to derive bounds. In particular. lsection~3l ( "Closed- form Bounds" ) approximates the 
summands of (1.2) and (1.3) in various ways to yield summations with closed-form 
expressions. On the other hand. Iscction 51 ("Bounding with the Standard Normal") 
replaces the summation of (1.3) with an integral, yielding a bound incorporating 



the distribution function of the standard normal. 

A few of these bounds appear in |Figurc 1| The upper and lower bound pair of 
are the tightest, and their forms are sufficiently similar to allow the gap to be 
analytically quantified. This comes at the cost of interpretability: they are rather 



(5.1; 



complicated. Contrastingly, the upper bound of (3.7) is simple: when n is odd, it is 
just (2cr) n+1 /2. Remarkably, the Chernoff bound for m even is (2a) m . (Whenever 
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Figure 1. Bounds arc identified by equation number, lower and 
upper bounds derived in this paper being respectively dotted and 
dashed. Shading identifies the region between the Chcrnoff and 
Slud bounds. The exact (central) binomial tail is marked with x's, 
however the bounds in (5.1) somewhat occlude it. 



the number of trials is odd, n is used; when it is even, m is used.) The relationship 
between the bounds of Iscction 31 and the Chernoff bound is explored in Isection 41 
The gap between these bounds, seemingly large in | Figure lj is quantified, which 
furthermore provides an alternate proof of the Chernoff bound. 

Among the lower bounds, only that of (5.1) consistently outperforms Slud's 
bound. Fortunately, both depend on the standard normal, and thus the compari- 
son can be made precise: Isection 6l discusses proving Slud's bound by weakening the 
bounds of (5.1) The proof is notable because it extends the sufficient conditions 
of the classical statement of Slud's bound. Unfortunately, the details of this proof 
are tedious, and relegated to |Appendix B| The task of producing a good, elemen- 
tary lower bound proved challenging; the lower bound of (3.5) which appears in 
|Figurc j] is only tight for p away from 1/2. A comparison of all bounds may be 
found in |Figurc~2 of Isection 71 

To close. [section 81 generalizes ITheorem l.ll to arbitrary tails, however no bounds 
arc derived. 



2. Central Binomial Tails via Random Walks 

Consider random walks on the integer line originating at 0, and at each step 
incrementing their position with probability p, or decrementing it with probability 
1 — p. When n is odd, ¥[B(p, n) > n/2] can be interpreted to mean the proba- 
bility mass of walks terminating with positive coordinate after n steps. To prove 
ITheorem 1.11 the first step is to quantify the effect which two trials have on this 
probability mass. 
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Lemma 2.1. When n is odd, 

W[B(p,n + 2) > (n + 2)/2] -W>[B(p,n) > n/2] = (p - 1/2) f, " + )er n+] 



(n+l)/2 

Proof. For mass to change sign in two steps, it must originate in a path ending at 
a coordinate adjacent to the origin, and move in the direction of the origin twice. 
Symbolically, 

2 l n \r,( n ~ l )/ 2 n _ ^(™+ 1 )/ 2 _ n n U(«+i)/2n _^("-i)/ 2 



two increasing steps two decreasing steps 

71 » n+1 



To finish, note that (, " ) = = \{, ™+w,)- □ 

1 V(n+l)/2/ n+1 V(n+l)/2/ 2\(n+l)/2/ 

Although the above proof depends on a random walk interpretation, it also goes 



through purely algebraically using (1.1) 



Accumulating the contribution of such steps up to n, it is possible to rewrite the 
binomial tail. 



Lemma 2.2. When n is odd, 

(n-l)/2 



F[B(p,n)>n/2]=p-(l/2-p) ]T (^)a 2j 

0=1 



Proof. Invoking ILcmma 2.11 
¥[B{p,n) > n/2] 



n-2 



= ¥[B(p, 1) > 1/2] + ]T (¥[B(p,j + 2) > (j + 2)/2] - P[B(p,j) > j/2]) 

j odd 

j odd 

and substituting 2j — 1 for j yields the lemma. □ 

When p < 1/2, as n - > 00, the central tail probability must approach (cf. 
for instance (3.7) I. As such, it should also be possible to compute the tail in a 
fashion complementary to ILcmma 2.21 instead accumulating the contribution of all 
remaining steps. 

Lemma 2.3. When n is odd and p < 1/2, 

P[B(p,n)>n/2] = (l/2-p) £ 



j>(n+l)/2 
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Proof. When p = 0, the result is immediate, thus take p <E (0, 1/2). Combining the 
Taylor expansion (1 - Aa 2 )- 1 / 2 = J2j>o ( 2 j) a2j with ILemma~2~2l 



J=l W 7 \ V J>(n+l)/2 W 



a 2 ^ 



J>(n+l)/2 W 7 



the result following since \/T — 4cr 2 = |1 — 2p| and p < 1/2. □ 



Proof of \Theorem (1.2) is handled by ILemma 2.2| whereas ILemma 2.31 takes 



care of (1.3) □ 

Remark 2.4. Going forward, the two constraints that n is odd and p < 1/2 will 
frequently appear. First note that p < 1/2 can be assuaged with 

¥[B(p, n) > n/2 + k] = P[B(l -p,n)< n/2 - k]. 

(And when p = 1/2, by ILemma 2~2l P[B(l/2,n) > n/2] = 1/2.) Additionally, the 
tail may be flipped with 

¥[B(p,n) > n/2 + k] = 1 - P[B(p,n) < n/2 + k]. 

Lastly, using the same random walk reasoning as in the proof of ILemma 2.1| central 
tail bounds on B(p, m) where m is even can be reduced to bounds on B(p,m — 1) 
via 

P[B(p,m) > m/2] -V[B(p,m- 1) > (m - l)/2] 

TO ~~ 1 ^ „(n»-2)/2 r] _ ym/2 = I ( ™> 

(m-2)/2j P [ l > 2\m/2 

3. Closed-form Bounds 

To produce bounds from lThcorcm lTT] the first task is to eliminate the binomial 
coefficient, which the following steps achieve by way of Stirling's approximation. 

Definition 3.1. Define 

9n + l 

l(n) 



3n(12n+ 1)' 

18n- 1 

u(n) — ; -. 

v ; 12n(6n+l) 

Remark 3.2. Note that, for n > 1, both are strictly increasing, and 

1 / \ 1 , 1 

_ > u {n) > -— > l{n) > - — . 
on 4n 3n 

Using the bounded form of Stirling's approximation (as in (9.15) from chapter 2 
of Feller 0) 



(^)" e V(12n + l) <n!< ^^" e l/(l 2 n) ) 



'27rn 

v e 

the central binomial coefficient can be bounded with 
(3.1) — =- < ( )< 



7TJ \J / V^J 
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Notice that combining (3.1) and (for instance) ILcmma 2.31 yields the somewhat 

hopeful relation 

(3.2) 

(1/2 - P ) £ ( 'A <P[^(p,n)>n/2]<(l/2-p) ]T ^ 



i>(n+l)/2 



'71" J 



j>(n+l)/2 



'IT J 



The remainder of this section starts from (3.2) (or from the analogous formula 
using the finite summation of ILemma 2.2[) . and manipulates the summation into 
one possessing a closed-form expression. The primary difficulty in (3.2) is the term 
j -1 / 2 , and the derivation of each bound can be characterized by its approach to 
this term. A sense of the relative performance of the bounds can be gleaned from 
|Figure 2| on page QT] 

The first bounds relax j 1 ^ 2 trivially; that is, upper bounding it with 1, and 
lower bounding it with j . 

Theorem 3.3. When n is odd and p G (0, 1/2), 

(l-2p)e / ("+ 1 )(2cr)™- 1 



(3.3) V[B(p, n) > n/2] > 

(3.4) f[B[p,n) > n/2] < 



^27r(n + 1) 
(2a) n+1 



(-ln(l-4a 2 )) 



(l-2p) v / 2^ + T) 



(Note that the lower and upper bounds may be related using ln(x) < x—1.) Both 
bounds become poor as p — > 1/2; in fact, the upper bound grows unboundedly, and 
the lower bound goes to zero. The upper bound, however, is sufficiently tight for 
p < 1/4 and odd n to prove the Chernoff bound in Iscction 4l 



Proof. From |(3.2)[ 



P[B(p,n)>n/2]>(l/2-p) £ 

j>(n+l)/2 



( 2(r )2i e i(2j) 



/7TJ 



> (l/2-p)e'(" +1 > x (2a) 2 'J+( n -V 



j> 



J jV(m+1)/2' 



and the bound follows using the Taylor expansion — ln(l — 2cr 2 ) = J2j>i(2 (7 ) 2:> 1 3 '■ 
Similarly for the upper bound, 



F[B(p,n) > n/2] < (1/2 -jj) ^ 

j>(n+l)/2 

1 -2p 



< 



j>(n+l)/2 
(2a) n+1 



v /27r(n + 1) 

1 - 2p 
~ i/27r(n + 1) V 1 - 4cr2 

To finish, use 1 - 4cr 2 = (1 - 2p) 2 . 

Another approach to the term j~ 1//2 is to lower bound with an exponential. 



□ 
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Theorem 3.4. When p < 1/2 and n is odd, 

(1 -2p)e'(" +1 )(2a)" +1 



(3.5) 



°[B(p,n) > n/2] > 



1 - 4<T V(™ +!)/(" + 3) + 



This lower bound also approaches zero as p — > 1/2, but is otherwise the tightest 
elementary lower bound in this paper. It can be seen to dominate the lower bound 
of (3.3) by taking n large and using a tangent approximation to In. 

Proof. Fitting an exponential to ((n + l)/2) -1 / 2 and ((n + 3)/2) -1 / 2 yields 



1 ( V(n+l)/2 
\f¥+W- W(" + 3)/2 



i-(n+l)/2 




j-(n+l)/2 



Thus, again using (3.1) and lLemma 2.31 



E ( 2 -) 




j-(n+l)/2 



□ 



fi /2 - nV'("+ 1 ) 
P[B(p, n) > n/2] > [ ' P p 

with the usual geometric sequence formula giving the statement. 

This section's last method of coping with j~ 1 ^ 2 relies upon the chain of equalitiefQ 

(3.6) 



Ex 3 
73 



\ 



x.J 



\3>V 



VJ 



J>ri 



VJ 



k-T] 

\ k>2 V j=n 7JW-~J) 



Definition 3.5. For any 77, k € Z + with 2?7 < fc, define 

k—rj 



1 



3 4 Vj( k -j) 
As it turns out, ^ is rather well behaved. 
Lemma 3.6. For any rj,k £ Z + wift 277 < fc, ip n (k) < ip v (k + 1) < tt 

Proof. Note that 

k-ri k-n , „ . 

= -\ E l cos " w = f E 

i=l-2j/k 
j=ri,...,k-ri 



1 



i=l-2j7fc V 
j=ri,...,k-r) 



As such, ip v (k) can be interpreted as a Riemann sum lower bounding the function 
(1 — a; 2 ) -1 / 2 on the interval (— 1,+1). Indeed, take 2/k to be the width of each 
rectangle, and when i < 0, take (1 + i 2 ) -1 / 2 to be the height at the right endpoint 
of a rectangle, otherwise when i > take it to be the height at the left endpoint. 
Since d(cos~ 1 (x))/dx = — (1 — a; 2 ) -1 / 2 , the value of the approximated integral is 
7r, which gives the upper bound. (To handle the discontinuity, apply the monotone 
convergence theorem to lim„_ i . 00 f 1 , ]{ n , . dx . .) 



^The idea for the approach comes rather naturally if attempting to relate [(3. 2) | to the Chernoff 
bound, as addressed in lsection 41 
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For the monotonicity statement, note that the Riemann sums of a convex, de- 
creasing function are increasing as the width of the subdivisions decreases (a proof 
of this fact is in | Appendix E[ ). The result follows by applying this to both halves 
of the function separately. □ 

With this machinery in place, the final bounds of this section may be established. 
Theorem 3.7. When n is odd and p < 1/2, 



(3.7) 



(2rr) n+1 e l ( n+1 '> (2<r) n+1 



V27r(n + 1) 2 
It is shown in lsection 41 that, with an even number of trials, the upper bound of 



(3.7) is tighter than the Chernoff bound for all p € [0, 1/2]. Furthermore, the ratio 



of the two approaches 2 as the number of trials grows. 

The lower bound of (3.7) has the weakness that, as the number of trials grows, 
it becomes poor. On the other hand, it has the distinction, among all bounds of 
this section derived from (3.2) that it does not approach as p — >• 1/2. 

Proof. Again using (3.2) but now dealing with j -1 / 2 via 



HI 



F[B(p,n) > n/2) < 



1 - 2p 



£ (2-) 2fc ^ l+ D/ 2 

V V fe>ri+l 



(k) 



< 



l-2p j (2a) 2n + 2 
2 V l-4cr 2 ' 



where the conclusion used ^(fc) < 7r; to finish, substitute yl — 4er 2 = |1 — 2p\. The 
lower bound proceeds analogously, but invoking ILcmma 3~6l to grant 2/(n + 1) = 
Vv+i)/2( n + !) < "0(n+i)/2(fc) for all k > n + 1. □ 

Note that all preceding bounds used the infinite summation form as presented 
in ILcmma 2.31 For the last pair of bounds in this section, the finite sum from 
ILcmma 2.21 is used, which predictably leads to a much different bound. 

Theorem 3.8. When n is odd and p < 1/2, 

2<7 2 e u ("- 1 V(l - (2a) 2 



(3.8) 



s [B(p, n) > n/2] >p- 



')^i(n-l) 



(3.9) P[B(p,n) > n/2] <p 



2aV( 2 Vl - (2(i)«-i 



Both (3.8) and (3.9) become exact as p — > 1/2, but are otherwise inaccurate. 

Proof. This proof does not differ greatly from the others in this section, with the 
exception of starting from ILcmma 2.21 For the lower bound, the key inequalities 
are 



(n-l)/2 

E 



(2<r) 



2,i 



> 



((2 ( 7)4-(2a) 2 ")^(n-l) 



1-4(T 2 



which makes use of the monotonicity of ip v . The upper bound is similar, but using 



the fact that ipi > 1. 



□ 
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4. Relationship to the Chernoff Bound 
Since [X > a] = [e tx > e ta ] for all t > 0, it follows by Markov's inequality that 

E(e tx ) 

FIX >a}< inf =^^; 
L ~ 1 ~ t>o e ta 

this is a form of the Chernoff bound (sec (3.6) in Chernoff [l|). Applying this to 
the central tail, when to is even, yields 

P[B(p,m) > m/2] < (2<j) m . 

It is no coincidence this bears a striking resemblance to the upper bound in (3.7)| 
that bound was derived with the intent of proving the Chernoff bound. In fact, 
adjusting (3.7) to even to as pcr lRcmark 2.41 

(2cr) m 



, to) > to/2] < 



m 
to/2 



< (2<r) r 



y/2 



7TTO 



-l/2\ 



This serves to not only prove the Chernoff bound (for this case) , it also states that 
the multiplicative error of the Chernoff bound is at least (1/2 + (27tto) 
When n is odd, the Chernoff bound is the slightly uglier expression 

n/2 

(4.1) F[B(p, n) > (n + 1) /2] < (2a) 



P 
1-p 



The ratio of this expression to the upper bound in (3.7) 

„2 



1 



1 



(4.2) 



1 



1-p 



1 



i/2 



n- 1 
n+1' 



which approaches 2 as n — > oo. It does not, however, exceed 1 for all p and all n. 
On the other hand, dividing the bound by the upper bound in (3.4) yields the ratio 

■ 

(4.3) 



(1 - 2p)^7r(n - 1) 



(l-p)V2 



n 2 -l 



The ratio in (4.2) holds when p > 1/4, whereas the latter ratio in (4.3) exceeds 1 
when p < 1/4. Thus, combining the two via a min yields a better bound. As will 
be discussed in Isection 71 a number of the bounds, when paired via min or max, 
form extremely good bounds. 

Lastly, note that the Chernoff bound was chosen because, for an even number 
of trials, it is it is tighter than the corresponding Hoeffding and Bernstein bounds. 
(For a proof, see | Appendix D| ) 

5. Bounding with the Standard Normal 

The preceding bounds all aimed for a closed-form approximation for either the 
infinite or finite summation in lThcorcm 1.11 In this section, however, the strategy 
is to replace the infinite summation with an integral. As usual, let $ and <j> be the 
distribution function and density of the standard normal. 



Theorem 5.1. Let n odd and p £ (0, 1/2) be given, and set 



T 



1 - $(V-(n+l)ln(4<7 2 ))) 



A 



(2a) n+1 
y/2n(n+ I)' 
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then 

(5.1) (l/2-p)e' ( " +1 )(T + A) <P[B(p,n) > n/2] < (1/2 -p)(T + A(l + fl)), 
w/iere 

i? < mini 1, - [ — ln(4cr 2 ) 

\ ' 4 \n + l y ' 

The most important property is that the expressions for the upper and lower 
bounds are nearly the same, providing for easy comparison. Concretely the additive 
error of either can be bounded with their difference 

(1/2 - p)(T + A(l + R)) - (1/2 -p)e l( - n+1 \T + A). 
Using e'< n+1 ) > e -V3(n+i) > i _ 1 /3( 71 + i) an d R < i yie i(j s 

("> 55^4 G T + C 1 + 5?STi)) (I ^ 

Since (1/2— p)T is increasing (along p G [0, 1/2]), it may be replaced with its limiting 



value 1/2. Substituting the maximizing value for p into the right summand of (5.2) 



and simplifying, the error is thus upper bounded by 2/5 (n + 1). Although coarse, 
this error bound provides some explanation of the accuracy of (5.1) evidenced in 
[Figure f] and [Figure 2| 

The plots use the minimum of the two choices for R (for every p) . As is discussed 
in lscction 61 it is possible to prove Slud's bound by relaxing these bounds, and when 
a choice for R must be made, 1 suffices. Lastly note that the more complicated 
bound on R, though usually better, is worse for small values of p. For instance, 
a sufficient condition for the complicated bound to be better (for any n > 1) is 
p > 0.0077. 

To prove the theorem, first note that a change of variable suffices to remove j^ 1 ^ 2 
from the integral. (Recall that this term was the primary difficulty in lscction 31 ) 

Lemma 5.2. When a e (0, 1/2), 

, 2a) 2j 2 (l - *(V-(n + !)M^ 2 ))) 
-dj - 



'(n+l)/2 VttJ v/-ln(4o- 2 ) 
Proof. To start, 

(2a) 2 ^ , f°° e^'M 4 ^) 

dj = / i=^<k- 



'(n+l)/2 V n J J(n+l)/2 V n J 

Applying the map j n- — j 2 /(2 ln(4cr 2 )) yields 

e~ ]2/2 ( -2j 



dj, 



V-("+i)in(4^) v / -^' 2 /(21n(4 ( T 2 )) V21n(4£7 2 ). 
which gives the statement after some algebra. □ 
Proof of \Theorem 5.1\ By the first order Euler-Maclaurin summation formula, 

- <W- r MV-^triw-ifflf^)*, 



i>(fc)/2^ J(n+l)/2V^J ^/2n(n + l) i(„+l)/2 

where {a;} is the fractional part of x. (To turn this expression into lower and upper 
bounds for P[B(p, n) > n/2], scale by (1 — 2p)e l( - n+1 ' > and 1 — 2p, which yields both 
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sides of (3.2) |. Bv lLcmma 5.2| the first term is T, and the second is A, so only the 
last term requires attention. To start, observe that 



dx \ \pKX I vttx V 2x 



d 2 f(2a) 2x \ {2a) 2x ( a 2 ln(4<7 2 ) 3 



czar \ y/irx J y/irx \ x 4ar 

Since a £ (0, 1/2), / < and /' > 0, and hence the integral is nonnegative (once 
again, this follows from exercise 9.16 of Graham et al. [3|), thus establishing the 
lower bound. Next 

, r , , /n , / d {2a) 2x \ , 1 f°° ( d (2a) 2x \ , 

({x}-12 )l—L> )dx<-- / Ufa^A, 
(n+i)/2 0™ / 2 J( n+1 y 2 \dx ^irx J 

establishing the first upper bound on R. (The same bound may be derived by 
starting with the naive integral bound instead of Euler-Maclaurin.) For the second 
upper bound, write 

/>oo />1 

/ {{x}-\/2)f{x)dx= / {x - 1/2) f(j + x)dx 

J(n+l)/2 j>(n+l)/2 J0 



[I (x - l/2)f (j + x)dx + J^(x- 1/2) f(j + x)dx 



i>(n+l)/2 



Since f{x) is negative and monotonic increasing, it follows that 

,1/2 f l/2 

(x - 1/2) f{j + x)dx < inf f(j +x) (x- l/2)dx = -f(j)/8, 



»e[o,i/2] Jo 
{x - l/2)/(j + x)dx < sup f(j+x) f (x - l/2)dx = f(j + l)/8. 

'1/2 s£[l/2,l] Jl/2 

As such, the sum telescopes, establishing the other bound on R. □ 

6. Relationship to Slud's Bound 

Slud's bound is the standard tool for lower bounding binomial tails. 

Theorem 6.1 (Slud !4f]). Let n, k be nonnegative integers with k < n, andp £ [0, 1]. 
When either (a) p < 1/4 and np < k < n, or (b) np < k < n(l — p), then 

' k — np^ 



(6.1) P[-B(p, n) > k] > 1 - $ 

Remark 6.2. Many presentations omit sufficient condition (a). Many also omit 
the integrality of k, which can be seen as necessary with the example n = 1 and 
p= k € (0, 0.5); in this case, Slud's lower bound is exactly 0.5 > p = F[B(p, 1) > k]. 

It is possible to start with the bounds in IThcorcm 5.11 and apply a battery of 
elementary inequalities (mostly tangent and secant approximations to the relevant 
functions) to weaken the inequalities into Slud's bound. The proof is quite tedious, 
and thus deferred to |Appcndix B| however a few points are worthy of mention. 

By the method of proof, it is immediate that the bounds of ITheorem 5.11 are 
tighter than Slud's inequality. In one case, care is even made to maintain a small 
separation, however quantifying the exact gap is hard. 




Figure 2. Bounds arc identified by equation number, lower and 
upper bounds derived in this paper being respectively dotted and 
dashed. Shading identifies the region between the Chernoff and 
Slud bounds. The exact (central) binomial tail is marked with x's. 




Perhaps most importantly, the proof was able to extend the sufficient conditions 
for Slud's inequality For n odd and m even, Slud's bound (for central tails) requires 
p < 1/2 — l/2n and p < 1/2, respectively. The new proof, however, holds for 

4U/ tTr" )' /a > ,<^(w. 

This is nice since Slud's bound is of a significantly simpler (and more intcrprctablc) 
form than the bounds of lThcorcm 5.11 

Empirical evidence seems to suggest that Slud's bound does not hold for all 
p, and in fact, as n — > oo, the maximal permissible p shrinks to 1/2. Also, the 
following appears to be true. 

Conjecture 6.3. When p £ (0, 1/2) and m is even, 

'(1/2— p)y/m\ If m 



P[B(p,m)>m/2] >l-$ 

\ a J A \rn/2 / 

Unfortunately, the bounds of lThcorcm 5.11 are not sufficiently tight to establish 
this; perhaps if the term e^" +1 - ) were handled better. 



7. Summary of Bounds 



|Figurc 2] contains plots of all bounds. The bounds of (5.1) are almost exact, 
which is in agreement with their error bound. The simple upper bound in (3.7) is 
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also generally good. On the other hand, most of the other bounds vary performance 
quite widely with p. This suggests use of pairs of bounds in tandem; for instance, 
as was mentioned in lscction 4[ the minimum of the upper bounds in (3.7) and 
suffices to prove Chernoff 's bound. Similarly, the max of the lower bounds in 



(3.4) 



(3.5) 



and (3.8) would work well. 

Slud's bound fares well, being the best lower bound with the exception of the 
bounds in (5.1) and (3.5) for certain values of p. In contrast, many upper bounds 
outperform the Chernoff bound. 



8. General Binomial Tails via Random Walks 

By following steps analogous to those of lscction 2[|Thcorcm l.ll readilv general- 
izes. (For details, see | Appendix A| ) 

Theorem 8.1. When n is odd, keZn [0,n/2) } and p £ (0, 1/2), 

k (n-l)/2 



j=k+l 

2j 



J>("+l)/2 V 

Furthermore 

(8.3) P[5(l/2,n ) >^ + fc]=2--- 1 + ^ (|) L- + 



-5" S (|)C^ 

j>(n+l)/2 V J 7 VJ 
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Appendix A. Proof of Theorem 18.1 
The first task is to generalize ILcmma 2.11 
Lemma A.l. When n is odd and k e Zfl [— n/2,n/2], 



n + 2 

B(p,n + 2) >^— + k 



1 k 
P ~ 2 + ~1 J V(n + 



B(p,n) > - + fc 



71 + 1 ^ (n+l)/2+fe n _ s(„+l)/2-fe 

l)/2 + k) P 1 W 



Proof. As in the proof of ILcmma 2.11 the change in probability mass comes entirely 
from the random walks which after n steps are at coordinates (n — l)/2 + k or 
(n + l)/2 + fc. Thus, as before, the mass gained minus the mass lost is 



n l T ,(™-l)/ 2 +*7l _ n l(i+l)/2-* 

(n-l)/2 + fc,r 1 PJ 

-< 1 -<» + lW0^ W(1 -' ,< """ 1,/ *~* 



_ p (n+l)/2+fe/ 1 _ p \(n+l)/ 



2-fe 



(n + 



(n- l)/2 + fc 

' +1 l„(n+l)/2+fc/1 _ \(n+l)/2-fc 

l)/2 + *,r 1 W 



-(1-P) 



(n + l)/2 + A 



(n + l)/2 + fc 



n + 1 



n + 1 
(n + l)/2 + * 



(n+l)/2+fc 



(1-P) 



(n + l)/2-fe 

71 + 1 

(n+l)/2-fc 



1 



□ 



2 ?i + l_ 

Substituting A: — in the above yields both the statement (and proof) of Lemma 
2.1. 

Proof of \Theorem 8.1\ Since the case k = is Theorem 1.1, take k ^ 0. To show 
it suffices to rewrite the tail as a telescoping series, and invoke ILcmma ATT] 



Note that this derivation holds for any p S (0, 1). 

F[B(p,n) > n/2 + k] 
= F[B(p, 2k + 1) > (2k + l)/2 + k] 

(n-l)/2-fe 

+ J2 (WP' 2fc + 1 + 2j) > (2k + l)/2 + k + j] 

3=1 

-P[B(p,2A;- l + 2j) > (2k- l)/2 + k + j] 

(n-l)/2-fe 



„2fc+l 



p 2k+l + 



E 

3=1 



1-p 



V 



1 



2 2j + 2k J \j + 2k 



2j + 2k \^Hi 



p^+j(i- p y 



k ( "^ /2 / 1 fc 



j=fe+i 



2j 

2 ' 2jy Vi + fc. 



r2j 



14 



MATUS TELGARSKY 



From here, (8.3) may be obtained by substituting p = 1/2. Note that, with the 
exception of the last step, p can happily take on values in {0, 1}, and the expression 
in the penultimate yields probabilities of 0, 1, respectively 
Next, using (2.5.16) from Wilf @, 



1-p 



E 

j>k 



2j 



2j 

3 + k 



y 



2k (2j + 2k 



2j + 2k\ j 



i 2k ( 1 - sJ\-^o 2 



2k 



(A.1) 



2 V 2cr 2 

p 2fc /l - \2p- 1| 
T~ I 2^ 



2k 



When p — 1/2, this expression is 1/2; thus, starting from (8.3)[ 



2 -2*-i + ^ f ah . J . ] 



j=fc+l 



2j7 Vi + fc 



+E(|)G + 3 *r 



2fc 

2fc/ \k + k 



J>(ra+l)/2 

2.7 ~ 

2jy Vj + fc 



2j7 Vi + fc 



E (£V.*.u-> 



i>(n+l)/2 

which is exactly [(8^4)] Finally, to handle |(8.2)"j first use (2.5.15) from Wilf @ to 
obtain 



EM 



1-pJ 2 

j>k 



2j j 



j>0 



~2)^\ j 



p 2k i p 



1\ 1 



1 - Vl - 4cr 2 



2fc 



(A.2) 



2/ VI - 4a 2 ^ 
p 2k \ 2p-l fl-\2p-l\ 



2 ) \2p-\\ 



2a 2 

2k 



2a 2 



Combining (A.l) and (A.2) it follows that 



1 , k\{ 2j \ _ 2j _p™ (I- \2p - 1| W 2p - 1 



|2p-l| 
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which further reduces to just when p < 1/2. Thus, from (8.1)| 

, x k (w-l)/2 , . , , 

p [s(P ,„,>„ /2+fc ]=^ + .-(^-) s +i G-'-^G?* 



l-p 



j>k 

- \ / Oh \ 

Ik 



'\ k\ ( 2k 



l-p) \2 P 2k) \k + k' ( 

J>("+l)/2 V J / \J < 



p 2k+l_ Q _ p 2k+l 

p \ k ^ (I k \ ( 2j 



l -p y ^ V 2 2j J \ j + k 

F/ 3>(n+l)/2 V J/ V 



which is [(O)] □ 
Appendix B. Proof of (Central) Slud's Bound 

1/2 



( 1 - 4(a/ " 4 »+2 ) 



(B.l) P[B(p, n) > n/2] > 1 - $ 



(n + l)/2 - 



When m is even and < p < | + ^(e'^/m) 1 / 3 , 

(B.2) p[s( p , m /2) > m /2] > 1 -$ (^^— 

When p € {0,1/2}, the statements are immediate, and thus disregarded. The 
proof is split into four parts, each reducing to the bounds in lTheorem 5.11 



Proof o/ [(B~T)1 when 0<p< 1/2. Set a = yj-{n + 1) ln(4<r 2 ) and p = ((n+l)/2- 
np) I (a-s/n); note that a < /?. Using the lower bound in lTheorem 5.11 the statement 
is implied by 

(1 - 2p)e l( - n+1 \l - $(a)) (1 - 2p)e l{ - n+1 \2a) n+1 



v/-ln(4<7 2 ) V 27r (" + !) 



>i- w 



Dropping the second term and using — ln(4cr 2 ) < (4cr 2 ) -1 — 1 = 2<r/(l — 2p), 
this is a consequence of 

2CTe z(n+1) (l-$(a)) > l-$(/3). 

< a < P so $(/?) - $(a) > <j)(/3)(P - a), and 1 - < (cf. (1.8) from 

chapter 7 of Feller [H ) , so this in turn is implied by either of 

2ae l( - n+1 U(P)(P - a) > (1 - 2ae'(" +1 >)^ 
2cre i (" +1 '(/3(/3-a) + l) > 1. 
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Establishing the latter inequality is ILemma C.ll 



□ 



Proof of (B.l) when ^ < p < 



1 - 



4(yM"+l)-l) 



4)1+2 



1/2 



Set /3 = (np — (n + 



1) / 2) / (a y/n) and a = y/—(n + 1) ln(4<r 2 ). By IRcmark 2.41 and symmetry of (j>, 
the theorem statement may be rewritten as 

F{B(1 -p,ri)> n/2] < 1 - $(/3). 

Discard the case that j3 < 0, since then 1 — $(/?) > 1/2 whereas P[_B(1 — p, n) > 
n/2] < 1/2 by ILemma 2.21 Since 2p — 1 < \J — ln(4er 2 ) this in turn is a consequence 
of 



(B.3) 



1 (l-2p)(2^^ . 



^2^(71+1) 

As per ILemma C.2| the conditions on p imply 

/ — j-j <a-0, 

meaning a > /?. Thus scaling both sides by </>(«) yields 

(2p- l)(2cr)™ +1 



y/2n(n+l) 



which implies (B.3) (since an integral can be lower bounded by a rectangle). □ 



Proof o/ [(R2)1 when <p < 1/2. S et a = -mln(4cj 2 ) and/3 = {{l/2-p)^/m)/a\ 
again, a < j3. Invoking lRemark 2.41 (3.1) and lThcorcm 5. ll the theorem statement 
is implied by 



, (m) / (l-2p)(l -$(<*)) (3/2 -p) (2a)' 



v/-ln(4<r 2 ) 



> 1 - *(y9). 



As in the proof when n is odd, use \J — ln(4cr 2 ) < 2cr/(l — 2p), but simply drop the 
term $(/?) — $(a), which gives the antecedent statement 

e l ( m \3/2-p)(2a) rr 



(B.4) 



> (l-2e'( m) cr)(l-$(/3)), 



V27rm 

which will be established using the fact 1 — $(/3) < min{^>(/3)//3, 1/2}. Set p = 
V3/4- l/(2e i ( m )); the statement is established for p S [p, 1/2] in ILemma C.3I so 
take p € (0,p]. Rearranging, the condition on p states 



and a < 1/2, so this becomes 



> 1. 



Next, 3/4 — p 2 = (3/2 — p)(l/2 — p) + 2er 2 , so the above can be re-arranged into 



e ; ( m )(1.5-p)(0.5-p) 



> 1 - 2e z(m V 
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To finish, the definition of (3 and scaling by </>(/3) implies 



e'W(l,5-p)^)^ (1 _ 2eiMtT) 



<m 



where substituting </>(/?) < </>(a) = (2a) /V2m yields (B.4) 



□ 



Proo/ o/ p^2)1 w/ien ± < p < 1/2 + (e 1 ^ /m) 1 / 3 /6. Set a = v /-mln(4cr 2 ) and 
/? = ((p — 1/2)y / to)/ct; again using iRcmark 2.4l and (3.1)| the theorem statement 
may be rewritten 

e z(m) f2erW 2 

F[B(1 -p,m-l)> m/2] ) — = — < 1 - 

V 27rm 



Invoking ITheorem 5.T1 2p - 1 < v /-ln(4cr 2 ), and 0(a) = (2cr) m / v 7 ^, this is 
implied by 

^-f^ < *(a) - m , 

which by <&(a) — <&(/?) >—(/? — a)0(a) is a consequence of 

(2p- 1 - e'< m >) 



(B.5) 



<a-j8. 



Set q = 2p — 1; the conditions on p mean g < (e^"^/m) 1 / 3 /3. Using algebra and 
some bounds on l(m), it follows that 

(m - 1)<? 3 + e i( "V + q - e 1 ^ < 0, 

which can be rearranged into 

e »("0 -q> m ' 



\-q l 



As before, g = 2p — 1 < ln(4(T 2 ), and since 1 — q 2 = 2p(2 — p) < 2a, this implies 
e l(m) _ ( 2p _ i) > m ( BlLzI - ^-ln^cr 2 ) 



2a 



which gives (B.5) 



□ 



Appendix C. Supporting Lemmas 
Lemma C.l. When p E (0,1/2) and n odd, 

2ae «n +1) (((n + l)/2-n P \ /(n + l)/2-np _ ^ + \ 



i >i. 
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Proof. Set r = p(l — p) = a 2 , and lower bound the left hand side according to 
2VFe I(n+1) 



V"l - 4r + 1 / ny/1 - 4r + 1 



2\/nr 



2\/nr 



\/-(.n + l)ln(4r) + 1 



iVl - 4r + 1 / nVl - 4r + 1 y^ra + 1)(1 - 4r) 



2 v / nr 



2\/nr 



4r 



J (l-4r) + 2nVl-4r + l 
4nr 



t(l-4r)y / ^Tl + ^/(n + !)(!- 4r) | i 
4ry7i 



(C.l) 



1 - 4r / n y/n(n + 1) 
VF 1 2 2 



^ i_i 2+1 

r \ 2 V n 



-(- 

v/F v2n 



V?(2) 



The goal will be to show that this final expression is lower bounded by 1. In 
particular, its derivative with respect to r is 



-1/2 J(n+1) 



1 + 4r In y n(n + 1) 
2r I 2 2 



1 



_( 1 1 J n + 1 
2rVl - 4r 1 2 V n 



1 1 

Anr 2 



by showing this is negative, it will suffice to show that (C.l) holds at p = 1/2. 



First consider the case that n G {1,2,3,4} (and note that r G (0,1/4), since 
p G (0, 1/2)). Each case can be checked manually by plugging in the given n, and 
using (1 — 4r)~ 1 / 2 > 1 + 2r (the linear approximation at r = 0). 

So take n > 5, and it will be shown that 



1 + 4r In y/n(n + 1) 



2r 



/ <-l/2- 
2rvT - 4r I 2 V n / ~ 7 



Since ri > 5, using some calculus, it holds that 



n y n ( n + 1) 1 
2 2 ~ ~4' 



1 - IJ Ii±I > 0.45. 
2 V n ~ 



Therefore 



* < — 



2r 



1 + 4r 



0.45 
v 7 ! -4r 
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Consider the case that r £ [0, 1/8], and replace (1 — 4r) x l 2 > 1 + 2r (again, the 
linear approximation at r = 0): 

If l + 4r 0.45 \ 1 / l + 4r , 

<-- _ + ( .45)(l + 2r 



2r \ 4 y/l-Ar J ~ 2r \ 4 

1/2 r 
~2r~ V 10 ~ 10 

Now taker <G [1/8, 1/4], and use the linear approximation (l — 4r) -1 / 2 > V2(l+4r): 

If l + 4r 0.45 

< -1/2. 



2r V 4 VI -4r, 
Since * is decreasing, the minimum is obtained when r = 1/4. Plugging r = 1/4 
[(Cl)| 

(01)1> e^+^l + n" 1 ). 



into 



This exceeds 1 for n = 1; for n > 3, since 1 + £ > cxp(a; — x 2 ) when a; £ [0, 1/2], it 
follows that 

e K«+l)(l + > C xp(/(n + 1) + (n- 1 - n~ 2 )) 

> exp(-(3n + l)" 1 + (n- 1 - n" 2 )) 

> 1. □ 

1/2 



Lemma C.2. Mien |<jp<| + |(l- ^-^jjP 1} ) anrf n is odd, 



2p-l „ /— ? 7T-: ^ 9N np-(n + l)/2 

< V-(n + 1) ln(4cr 2 ) v , 



Vn + 1 

Proof. The conditions on p are equivalent to 



> (4n + 2)p 2 - (4n + 2)p + Vn(n+1) - 1 = -4ner 2 - 2ct 2 + y / n(n+T) - 1. 

Note that y~ 1,>2 is lower bounded by its Taylor expansion 1 + (1 — y)/2, meaning 

1 + 2a = 1 + (1 - (1 - 4(T 2 ))/2 < (1 - 4a 2 )- 1/2 = (1 - 2p)-\ 

Furthermore 4cr 2 < 2a (since f is nondecreasing on [0, 1]), so the above condition 
implies 



i/n(n + 1) < 2na + (1 - 2p) _1 . 
With some rearranging, this becomes 

^=i< v / (n + l)(l-4. 2 ) - np - (n l 1)/2 , 

and since — ln(4tr 2 ) > 1 — 4cr 2 , the statement follows. □ 

Lemma C.3. When m is even and p £ [p, 1/2], 

e'( m >(3/2-p)(2<rr i(m) . 0(/3) 1 
7 == >(l-2e< MH-,-}, 



w/iere /? = ((1/2 -<p)fm)/<J and p = ^3/4- l/(2e'( m )). 
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Proof. First, notice that the left hand side is decreasing along p £ [p, 1/2. Starting 
from the derivative: 

d ( ( e'(™) s 
lirm , 



dp VVV2 



(|(p(i-p)r /2 -p(p(i-p)r /2 )) 
(5)(t«'-^- ! " 

- (p(l -p))™/ 2 - -p))Wa-i(i _ 2 p)j 



- l{m) \ 2/ . 3m 



W27rm/ 



(p 2 (l + m)-p(l + 2m) + — ). 



Setting this to zero and solving the quadratic yields 



1 + 2m ± v 7 1 + m + to 2 

P = ■ 

2 + 2m 

Notice that since (1 + 2m)/(2 + 2m) > (1 + m)/(2 + 2m) = 1/2, at least one of 
the solutions exceeds 1/2. Let p* denote the solution subtracting the discriminant. 
Below, it is shown that p* < p. But since the derivative evaluated at 1/2 is negative, 
it must follow that the left hand side is decreasing along [p, 1/2]. 
Since (1/2 + m) 2 = 1/4 + m + m 2 < 1 + m + m 2 , it follows that 

„ 1 + 2m - (1/2 + m) _ 1 + 2m 
P ~ 2+ 2m ~4+4m' 

By inspection, p* < p for m £ {2, 4, . . . , 28}. Next, since —l(m) < (3?n) _1 , 

p = ^3/4- e-'(' m )/2 > ^3/4- e-VSm^. 

Any convex function may be upper bounded by its secant along an interval; thus 
along [0, 1/6], e x < 1 + 6x(e 1 / 6 - 1). Furthermore, (3m)- 1 e [0, 1/6] since m > 2, 
thus 



(C2) p>J*-i( 1+ *!lf±±-) = Jl/4 - t!L±. 

y ' y - y 4 2 V 1/6 3m y V 7 m 

Next, note that 

mp 2 (4 + 4m) 2 - m(l + 2m) 2 

= 4m(l + m) 2 - 16(e 1/6 - 1)(1 + 2m) 2 - m(l + 2m) 2 

= 3m + 4m 2 - 16(e 1/6 - 1)(1 + 2m) 2 - m(l + 2m) 2 , 

which exceeds zero when m > 30. Rearranging, this yields p > p* . 

Now consider the right hand side of the lemma statement, note that it is upper 
bounded by 1/2 — e l ( m >cr, which decreases asp-> 1/2 since a increases along this 
interval. Combining all these pieces, to prove the inequality, it suffices to show that 
the left hand side at 1/2 exceeds the right hand side at p. 



First upper bound the quantity on the right hand side. Continuing from (C.2] 
and using the secant approximation s/x > 1/6 + 4x/3 along [1/16, 1/4], 



eV6_i i 4 / e^-lX 1 1 

> \/l/4 > - + - 1/4 > . 

~ v 1 m " 6 3 I ' m ~ 2 4m 
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On the other hand, since yfx < x + 1/4 (first-order Taylor (tangent) at 1/4), 
e x > 1 + x, and (4m) _1 < —/(to), 

^3/4- e- ; (™)/2 < ^3/4- e-V^n^ < ^3/4 - (1 - l/4m)/2 

= Vl/4 - l/8m < 1/2 - l/8m. 

Combining these, 

2<r = V4p(l - p) > \fl - 1/4to- 1/8to 2 > 1 - l/4m - 1/8to 2 > 1 - l/3m 

the last two steps following since -y/x > x on [0, 1], and — l/8m 2 > — l/12m. Insert- 
ing this into the right hand side (with 1/2 in the min) and using e^™* 1 > 1 — l/3m, 

1(1 - 2e /(m) a) < hi - (1 - l/3?n) 2 ) < l/3m. 

On the other hand, the left hand side (at p = 1/2) may be lower bounded as 



> l-l/3m 5/6 



> 



> 



\/2irm \f2itm \/2irm 
Comparing the square of this lower bound on the left hand side, and the square on 
the upper bound of the right hand side, it is clear the left hand side is greater, thus 
completing the proof. □ 

Appendix D. Comparison of Existing Central Tail Upper Bounds 

Applying Hocffding, Bernstein, and Chernoff bounds to F[B(p,n) > n/2] with 
even m and p < 1/2 yields 

W[B(p, to) > to/2] < exp[-m(l - 2p) 2 /2] Hoeffding, 

3m(l/2 -p) 2 



D [-B(p, to) > to/2] < exp 



(l + 4p)(l-p) 



"[B(p, to) > to/2] < [4p(l - p)] m/2 = cxp(y ln(4p(l - p))) 



Bernstein, 
Chernoff. 



Theorem D.l. The following inequalities relate the performance of these bounds: 

3m(l/2 -p) 2 



[4p(l-p)]™/ 2 < 



exp 



(l + 4p)(l-p) 
[4p(l - p)] m/2 < exp[-m(l - 2p) 2 /2] < exp 



< exp[-m(l - 2p) 2 /2] 
3to(1/2-p) 2 



ifpe [0,1/4]; 

ifp e [1/4, 1/2]. 



(l+4p)(l-p)_ 

Proof. Since exp is monotonic increasing, bounds will be compared by looking solely 
at the exponents. 

First, note that the Chernoff Bound is always better than the Hoeffding bound: 

~{l-2pf. 



^ln(4p(l-p))< y(4p(l-p)-l) 



Next, the ratio of Hoeffding's bound to Bernstein's bound is 

|(l + 4p)(l-p). 

By setting this quadratic to 1 and solving, the ratio is equal when p € {1/4, 1/2}. 
Furthermore, it is concave, and attains a maximum at p = 3/8. Combining these 
facts, it must be the case that the ratio is less than or equal to 1 along p £ [0, 1/4], 
and greater than or equal to 1 along p £ [1/4, 1/2]. 
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Figure 3. Given a convex, decreasing function /, forming Ric- 
mann sums with successively finer subdivisions yields a sequence 
of monotonic increasing approximants. 



To finish, it remains to be shown that the Chernoff bound is less than the Bern- 
stein bound along p <G [0, 1/4]. Let /, g denote the Chernoff and Bernstein bounds, 
respectively, df /dp > and dg/dp > along this interval, meaning both are increas- 
ing. Thus the result follows by the fact that /(1/8) < gr(0) and /(1/4) < g(l/8). □ 



Appendix E. Riemann Sums of Convex, Decreasing Functions 

Lemma E.l. Let intervals (a, 6] C [c,d], integersn < m with (d—c)/m < (b—a)/n, 
and a function f convex and decreasing on (c,d] be given. Let R(f; (t, u],v) denote 
the Riemann sum approximation of J. f consisting of v equal pieces, whose height 
is f evaluated at their right endpoint. Then R(f; (a, b],n) < R(f; (c, d], m). 

Proof. Let / denote some block of R(f;(a,b],n); that is, there is some integer 
1 < J < n such that I = [a + j(b — a)/m,a + (j + l)(b — a)/m]. The desired fact 
will be shown for the restriction to /, from which the general statement follows by 
considering all n pieces of [a, b\. 

The ingredients of the proof appear in figure [3] In particular, consider the 
greatest point within / where the right endpoint of a block of R(f; (c,d},m) falls 
(such a point must exist since R(f; (c, d], m) has narrower blocks). Let w = f{a + 
(j + l)(b — a)/m) be the height of the block, and let x be the offset at which this 
point falls. Furthermore, let y be the height above w of the block. 

Now consider the immediately next block (in R(f; (c, d], m)); its boundary must 
fall outside /. Let z denote this distance beyond the edge of I, and let u be the 
height below w of this point. By assumption, it must be the case that z < x. 
Furthermore, since f is convex on (c, d], it must be the case that -r-r- — > -. Thus, 
to compute the area with respect to R(f\ (c, d], m), one has the lower bound 

, . / 1 \ . . w ( 1 \ yz w 

x{w + y) + x (w — u) > h xy — x — ; > — . 

\n J n \n J 1/n — x n 
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Note that this last quantity is precisely the area of the block with respect to 
R(f; (a, b],n), which completes the proof. □ 
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